Web Survey Bibliography
Title Is accuracy only for probability samples? Comparing probability and non-probability samples in a country with almost full internet coverage
Author Martinsson, J., Dahlberg, S., Lundmark, S.
Source AAPOR
Year 2013
Access date 12.04.2014
Full text
Abstract
Commercial on-line panels based on non-probability samples have begun to be widely used not only in traditional market research but also in more academic research. But is the quality and accuracy of such data comparable to that of probability based samples? The overall aim of this study is to compare the quality of probability based and non-probability based on-line panels in Sweden, a country with almost full internet coverage. We proceed in two steps. Firstly, we compare the accuracy of three survey modes all using random samples: postal survey, telephone survey, and web survey. Secondly, we compare the accuracy of two commercial non-probability based panels with two commercial probability based panels, using the traditional mail and telephone surveys as benchmark surveys. Demographics are compared to government records, and attitudes are compared to benchmark studies of high quality and high response rate.
In order to allow comparisons, seven surveys with comparable questions were run at approximately the same time. We compare the accuracy of the four commercial on-line panels both with and without weights. In contrast to previous studies, the results indicate a surprising similarity in terms of accuracy between probability panels and non-probability panels. The two non-probability based on-line panels do not seem to be less accurate than probability based on-line panels in terms of demographics, nor do their estimates of political attitudes seem to differ more from traditional methods such as a high response rate mail survey. We conclude that a larger comparison based on more demographic and attitudinal variables are needed.
Access/Direct link
Homepage (abstract) / (full text)
Year of publication2013
Bibliographic typeConference proceedings
Web survey bibliography - 2013 (465)
- Hunting for healthy new ideas: Experiences in global online qualitative; 2013; Mabey, M., Ziffer, J.
- Comparison of US Panel Vendors for Online Surveys; 2013; Cella, D., Craig, B. M., Hays, R. D., Pickard, A. S., Reeve, B. B., Revicki, D. A.
- Web Social Science: Concepts, Data and Tools for Social Scientists in the Digital Age; 2013; Ackland, R.
- Recruitment of Sex Buyers: A Comparison of the Efficacy of Conventional and Computer Network-Based Approaches...; 2013; Kolar, K., Atchison, C.
- The Digital Divide in Europe; 2013; Zillien, N.; Marr, M.
- Use of Web and Phone Survey Modes to Gather Data From Adults About Their Young Adult Children: An Evaluation...; 2013; Abbott, R. D.; Fleming, C. B.; Marchesini, G.; Elgin, J.; Haggerty, K. P.; Woodward, D.; Catalano, R...
- Postal recruitment into a longitudinal online panel survey. The effects of different number of reminder...; 2013; Martinsson, J.
- Investigation of background acoustical effect on online surveys: A case study of a farmers' market...; 2013; Tang, Xi.
- The world in 2013. ICT facts and figures; 2013
- The Recruitment of the Access Panel of German Official Statistics from a Large Survey in 2006: Empirical...; 2013; Amarov, B.; Rendtel, U.
- Effects of Gamification on Participation and Data Quality in a Real-World Market Research Domain ; 2013; Cechanowicz, J., Gutwin, C., Brownell, B., Goodfellow, L.
- Migraine and pregnancy: an internet survey; 2013; Allais, G. et al.
- The Impact of News Photos on Support for Military Action; 2013; Soroka, S.; Loewen, P.; Fournier, P.; Rubenson, D.
- Ideal participants in online market research: Lessons from closed communities; 2013; Heinze, A., Ferneley, E., Child, P.
- Evaluating Arts-Based Cancer Education Using an Internet Survey among Alaska Community Health Workers...; 2013; Cueva, M., Cueva, K., Dignan, M., Lanier, A., Kuhnley, R.
- The internet user profile of Italian families of patients with rare diseases: a web survey; 2013; Tozzi, A. E., Mingarelli, R., Agricola, E., Gonfiantini, M., Pandolfi, E., Carloni, E., Gesualdo, F.,...
- Internet health information seeking is a team sport: Analysis of the Pew Internet Survey; 2013; Sadasivam, R. S., Kinney, R. L., Lemon, S. C., Shimada, S. L., Allison, J. J., Houston, T. K.
- Social Research Methods - Qualitative and Quantitative Approaches, Second Edition; 2013; Bernard, H. R.
- Microsoft Security Intelligence Report, Volume 15; 2013
- A Comparison of Results from a Spanish and English Mail Survey: Effects of Instruction Placement on...; 2013; Wang, K., Sha, M.
- Research Note: Reducing the Threat of Sensitive Questions in Online Surveys?; 2013; Couper, M. P.
- Is accuracy only for probability samples? Comparing probability and non-probability samples in a country...; 2013; Martinsson, J., Dahlberg, S., Lundmark, S.
- Internet Coverage and Coverage Bias in Europe: Developments Across Countries and Over Time; 2013; Mohorko, A., de Leeuw, E. D.,Hox, J.
- Identifying the real differences of opinion in social media sentiment; 2013; Pettit, A.
- Global market research 2013; 2013
- Exploring the Digital Nation: America’s Emerging Online Experience; 2013
- Measurement Effects of Survey Mode on the Equivalence of Attitudinal Rating Scale Questions; 2013; Klausch, L. T., Hox, J., Hox, J., Schouten, B.
- The effect of email invitation characteristics and response reluctance on non-response in web forum...; 2013; Petrovcic, A., Lozar Manfreda, K., Petric, G.
- Education in the Responsible Conduct of Research in Psychology: Methods and Scope; 2013; DiLorenzo, T. A., Becker-Fiegeles, J., Gibelman, M.
- Different approaches to measure ego-centered social support networks: a meta-analysis; 2013; Hlebec, V., Kogovsek, T.
- Decisions, Observations, and Considerations for Developing a Mobile Survey App and Panel; 2013; Roe, D. J., Zhang, Yu., Keating, M.
- Online questionnaire development: Using film to engage participants and then gather attitudes towards...; 2013; Middleton, A., Bragin, E., Morley, K. I., Parker, M.
- Intra-individual variation of extreme response style in mixed-mode panel studies; 2013; Aichholzer, J.
- Australia: building a 21st century readership survey; 2013; Green, A., White, H.
- The new swiss national readership survey: fit for the future ; 2013; Amschler, H., Hoffmann, J.
- Co-creation with TickiT: Designing and evaluating a clinical eHealth platform for youth; 2013; Whitehouse, S. R.
- Foster strengths and circumvent weaknesses: Advantages and disadvantages of online versus face-to-face...; 2013; Qiu, M., McDougall, D.
- Decision making in web survey participation of undergraduate students; 2013; Fan, W.
- The effect of language in answering qualitative questions in user experience evaluation web-surveys; 2013; Walsh, T., Nurkka, P., Petrie, H., Olson, J.
- Assessing data quality with time measurements of responses in the Estonian mixed-mode survey experiment...; 2013; Lumiste, K.
- Mixed-mode and the European Social Survey (ESS): evidence from the UK ; 2013; Park, A., Humphrey, A., Agur, M.
- Does Internet Use Improve Surveys?: Studies of Costs, Response Rates and Coverage. ; 2013; Lesser, V. M., Newton, L., Yang, D.
- An Experimental Evaluation of How Mode Sequence for offering Internet, Mail and Telephone Options Affects...; 2013; Finamore, J., Dillman, D. A.
- Survey errors and costs - comparison of mixed-mode and face - to face ESS surveys in Estonia; 2013; Ainsaar, M., Lumiste, K., Lilleoja, L., Roots, A.
- ESS Mixed Mode Experiment Results in Estonia (CAWI and CAPI Mode Sequential Design); 2013; Ainsaar, M., Lilleoja, L., Lumiste, K., Roots, A.
- Video Content in Web Surveys: Effects on Selection Bias and Validity; 2013; Shapiro-Luft, D., Cappella, J.
- Recruitment strategies of methamphetamine-using men who have sex with men into an online survey; 2013; Wilkerson, J. M., Shenk, J. E., Grey, J. A., Rosser, B. R. S., Noor, S. W.
- Quality of Web surveys; 2013; Revilla, M.
- Web Surveys and Official Statistics: Perspectives and Cases ; 2013; Martelli, B.
- The use of paradata to investigate non-response ; 2013; Vicente, P.